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PRL  DICTINC.  SUCCESS  IN  Till  AFROTC  SCI  IOL  ARSI I IP  PROGRAM 


I.  INTRODUCTION 

A significant  proportion  of  expenditures  in  the  Air  Force  Reserve  Officer  Training  Corps  (AFROTC) 
are  devoted  to  the  College  Scholarship  Program,  which  each  year  underwrites  6, ‘'00  scholarships  at  an 
annual  cost  of  approximately  14  million  dollars.  The  magnitude  of  that  investment  requires  efficient 
management  to  avoid  unnecessary  losses  due  to  attrition,  to  maintain  the  quality  of  graduates,  and,  in 
general,  to  achieve  an  optimum  return  for  each  dollar  invested. 

The  program  authorizes  scholarships  of  varying  lengtlis:  4-year,  3 -year,  and  2-year,  each  representing 
the  total  costs  of  tuition,  fees,  and  books  for  the  designated  enrollment  period.’ Scholarship  recipients  also 
receive  a monthly  stipend  of  SI 00.  While  the  annual  expenditures  per  student  vary  by  school,  they 
typically  range  between  SI. 200  and  S3, 000  with  an  average  value  of  approximately  $2,000.  Historical  data 
on  student  attrition  in  the  4-ycar  program  shows  that  approximately  half  of  the  students  awarded 
scholarships  failed  to  complete  the  program  for  various  academic  and  other  reasons.  Tire  attrition  rates  for 
the  3-  and  2-ycar  programs  are  generally  less  (averaging  15%  and  12%,  respectively)  as  a result  of  the  higher 
loss  rates  associated  with  the  first  academic  year. 

In  1975,  Headquarters  AFROTC  commissioned  a study  of  the  scholarship  award  procedures  with  a 
view  toward  reducing  student  attrition  in  the  program.  This  could  be  accomplished  if  a certain  proportion 
of  “high  risk*’  applicants  (i.e.,  those  with  little  probability  of  completing  training)  could  be  identified  prior 
to  actually  awarding  scholarship  benefits.  The  research  was  to  be  conducted  in  two  phases.  During  lltase  I. 
the  basic  feasibility  of  establishing  selection  criteria  was  to  be  examined  using  historical  training  records  for 
a 5-ycar  period.  The  principal  objectives  were. 

1.  To  document  empirical  relationships,  if  any,  between  individual  student  aptitudes  and  probability 
of  successful  completion, 

2.  To  examine  modifying  influences  attributable  to  the  type  of  academic  major  and  to  the  overall 
difficulty  level  of  the  school,  and 

3.  To  determine  the  potential  applicability  of  the  procedure  to  the  4-,  3-,  and  2-year  scholarships 
programs. 

During  the  second  phase,  selection  procedures  would  be  refined  using  an  expanded  predictor  set  which  had 
not  yet  matured.  The  purpose  of  this  report  is  to  document  the  interim  findings  from  Phase  1. 


il.  APPROACH 


Subjects 

Records  of  final  training  disposition  for  AFROTC  participants  during  IT  71  through  FY  75  served  as 
tire  basis  for  analysis  (N  = 22,663).  These  people  were  enrolled  during  that  time  period  at  175  U.S.  colleges 
and  universities  offering  Ah  ROTC  programs.  Moreover,  they  had  cither  successfully  completed  the  program 
or  had  disenrollcd  for  academic  or  motivational  reasons.  The  schools  are  considered  representative  of  all 
major  academic  institutions  in  both  the  public  and  private  sectors.  A distribution  of  students  by  program 
category  indicated  10%  were  4-year  scholarship  recipients  (N  = 2,235),  11%  were  3-year  scholarship 
recipients  (N  = 2,482),  and  79%  were  cither  2-ycar  scholarship  recipients  or  non- scholarship  contract 
students  enrolled  in  the  advanced  AFROTC  program  (N  = 17,946).  The  latter  two  categories  were  combined 
in  the  same  sample  since  both  were  required  to  sign  2-year  contracts  contingent  on  successful  completion  of 
the  junior  and  senior  years  of  academic  study. 


Predictor  Variables 

Variables  for  the  analysis,  unless  otherwise  indicated,  were  obtained  front  historical  records  of 
Al'  ROTC  participants  maintained  at  the  Air  Force  Human  Resources  Laboratory 

I Aptitude  Measures  Individual  aptitude  measures  for  each  participant  were  obtained  front  the  Air 
Force  Officer  Qualifying  Test  (AFOQT),  a group-administered  batter)  designed  to  evaluate  aptitudes  which 
are  important  for  commissioned  officer  performance  and  success  f Miller,  1968,  1969).  The  AFOQT  consists 
of  13  subtests,  each  included  in  one  of  several  test  booklets.  The  subtests  taken  in  various  combinations 
yield  three  composite  measuiesin  percentile  form  as  shown  in  Table  I. 


Tabic  I.  Subtests  and  Composites  of  the  AFOQT 


SubtMt 

Officer 

Quality 

Aptltuda  Compoiitai 

Pilot  Nav'Tieh 

Quantitative  Aptitude 

X 

X 

Verbal  Aptitude 

X 

Officer  Biographical  Inventory 

X 

Scale  Reading 

X 

Aerial  Landmarks 

X 

General  Science 

X 

Mechanical  Information 

X 

X 

Mechanical  Principles 

X 

X 

Riot  Biographical  Inventory 

X 

Aviation  Information 

X 

Visualization  of  Maneuvers 

X 

\ 

lnstniment  Comprehension 

X 

Flight  Orientation 

X 

a.  The  Officer  Quality  (OQ)  Composite -The  OQ  composite  is  primarly  a measure  of  general 
learning  ability  and  officer  quality.  It  contains  measures  of  verbal  and  quantitative  aptitude,  reasoning 
ability,  background  knowledge  relative  to  world  events,  and  an  inventory  of  biographical  material  predictive 
of  officer  leadership.  Applicants  with  high  Officer  Quality  scores  may  be  expected  to  do  well  in  any 
technical  training  program  having  appreciable  academic  content. 

b.  77 ic  Pilot  Composite  This  is  a measure  of  some  of  the  characteristics  necessary  for  successful 
completion  of  pilot  training.  It  includes  subtests  of  mechanical  experience,  spatial  information,  and  ability 
to  understand  and  interpret  information  received  from  aircraft  instruments.  Applicants  with  high  scores  on 
this  composite  have  considerably  better  chances  of  completing  pilot  training  than  those  with  low  scores 

c The  Navigator- Technical  (Nai'-Tcch)  Girnpositc- The  Nav-Tech  composite  is  a measure  of 
abilities  to  interpret  dials  and  tables,  to  understand  scientific  and  mathematical  principles,  and  to 
comprehend  mechanical  and  spatial  concepts.  It  is  designed  to  predict  success  in  training  courses  requiring 
these  abilities  such  as  navigator  training,  communications,  electronics,  maintenance,  engineering,  and 
technical  intelligence. 

2.  Institutional  Selectivity:  This  variable  was  designed  to  take  into  account  the  varying  degrees  of 
difficulty  presumed  to  exist  between  academic  institutions  hosting  AFROTC  detachments.  It  was  defined 
operationally  on  the  basis  of  the  average  American  College  Test  (ACT)  scores  for  entering  freshmen 
(American  Council  on  education,  1968)  at  each  host  college  or  university.  In  the  analysis,  all  persons 
enrolled  at  the  same  academic  institution  received  identical  selectivity  scores. 
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3.  Academic  Major  As  a general  index  of  the  effect  of  academic  specialt>  on  probability  for  success, 
all  cadet  academic  majors  were  grouped  into  two  mutually  exclusive  categories  Science  and  higjneermg 
(S&E)  versus  Non -Science  and  Engineering  as  shown  in  Table  2.  These  definitions  arc  consistent  with  the 
AEROTC  practice  of  identifying  certain  specialties  which  are  of  particular  interest  in  subsequent  active 


duty  assignments.  These  academic  specialties  arc  also  known  as  Category  III  majors. 

Table  2.  Academic  Specialties  Designated  Science  and  Engineering 

Academic  Major 

Speclaltlat 

Science  and  Engineering 

Aeronautical  Technology,  Aeronautical  Engineering.  Aerospace  Engineer- 
ing, Astronautical  Engineering,  Civil  Engineering,  General  Engineering, 
Industrial  Engineering,  Mechanical  Engineering,  Architectural  1 ngineering. 
Architecture,  Electrical  Engineering,  Electrical  Technology.  Communica- 
tions Technology  , Computer  Sciences,  Mathematics.  Physics,  Space  Physics, 
Meteorology 

Non-Science  and  Engineering 

All  other  academic  specialties 

Criterion  Variable 

Training  outcome  defined  on  the  basis  of  graduation  versus  elimination  served  as  the  principal 
criterion  for  developing  the  selection  system.  The  elimination  category  included  all  types  of  discnrollment 
for  any  reason  including  academic,  motivational,  physical,  etc. 


Analyses 

Individual  student  records  were  partitioned  into  three  samples  defined  on  the  basis  of  program 
length:  (a)  4-ycar  scholarship  recipients,  (b)  3-year  scholarship  recipients,  and  (c)  2-ycar  scholaiship 
recipients  and  other  contract  students.  Within  each  sample,  separate  regression  analyses  were  conducted  to 
determine  the  effects  of  the  predictor  variables  on  training  outcome  (graduated  vs.  eliminated).  1 he 
functional  relationships  initially  defined  may  be  expressed  as  follows: 

Training  Outcome  = f (Aptitude  x Institutional  Selectivity  x Academic  Major). 

In  defining  the  initial  prediction  model,  a large  number  of  nonlinear  and  interaction  terms  weie 
generated  front  the  primary  variables  to  insure  relatively  complete  investigation  of  all  possible  relationships. 
To  test  for  effects  attributable  to  specific  predictor  measures,  several  reduced  models  were  also  constructed 
in  such  a way  that  various  components  of  the  initial  prediction  model  could  be  systematically  eliminated 
from  consideration.  Comparisons,  based  on  the  statistical  accuracy  of  each  model,  were  performed  using 
the  F-ratio  and  associated  probability  values  (Ward  & Jennings,  l ‘>73).  Complete  specifications  for  the 
analysis  including  variable  descriptions,  prediction  models,  and  specific  comparisons  pcrlonued  are  given  in 
Appendix  A. 

III.  RESULTS  AND  DISCI  SSION 

Basic  descriptive  data  by  subsample  (Table  3)  indicated  that  people  enrolled  in  the  various  programs 
differed  in  a number  of  respects.  The  average  OQ  score  in  Die  4-ycar  program  was  61  versus  68  in  the  >->  car 
program  and  57  in  the  2-year/othcr  program.  Scores  on  the  Riot  composite  were  somewhat  more  consistent 
across  groups  averaging  57,  58,  and  55,  respectively.  The  highest  average  Navigator-Technical  score  was 
observed  in  the  3-year  scholarship  group  (64)  with  lower  averages  being  noted  in  the  4-ycar  and  2-ycar 
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Tabic  3.  Means  and  Standard  Deviations  of  Primary  Variables 


Vn 

rlablat 

Scholarthlp  Proiram 

Four  Yaar 
tN  = 2,235) 

Thro*  Yaar 
(N  « 2,452) 

Two  Year/Othar 
tN  * 1 7,946) 

Mean 

so 

Mean 

5D 

Main 

SD 

AFOOT 

OQ 

61  3‘) 

23.53 

68.42 

22.18 

56  99 

26  93 

AIOQT 

Pilot 

57.23 

23.96 

58.25 

24.82 

55.47 

27.13 

AIOQT 

Nav/Tcch 

58.45 

22.46 

63.90 

22.95 

51  94 

27.98 

S&E  vs  Non-S&l 

.29 

Ah 

.31 

.46 

.18 

.38 

Average  ACT 

23.82 

2.26 

23.34 

2.48 

23.05 

2.52 

AFROTC  Completion 

.50 

.50 

.85 

.36 

.88 

.33 

cohorts  (58  vs.  52).  Tire  proportion  of  science  and  engineering  students  in  each  program  was  equivalent  for 
both  the  4-  and  3-year  groups  at  approximate^  3(y  . Only  18%  of  the  2-ycar/other  scholarship  students 
were  designated  science  and  engineering  majors.  Average  ACT  was  essentially  identical  for  all  groups.  The 
overall  completion  rate  for  students  awarded  4-year  scholarships  was  50%.  Completion  rates  in  the  3- and 
2-year  programs  were  85%  and  88' >.  These  data  highlight  the  high  rate  of  attrition  normally  associated  with 
the  freshman  academic  year. 

Results  of  the  regression  analysis  to  determine  the  unique  effects  associated  with  aptitude  scores  (00, 
Pilot,  and  Nav-Tcch),  academic  major,  and  institutional  selectivity  on  program  attrition  rates  are  shown  in 
the  Appendix  (Table  A3)  and  summarized  in  Table  4.  There  was  a remarkable  similarity  of  results  within 
each  of  the  programs.  The  full  prediction  model  containing  all  elements  of  information  available  for  each 
student  yielded  significant  predictions  of  overall  success  in  each  program.  In  subsequent  comparisons,  the 
unique  effects  attributable  to  the  Officer  Quality  composite  and  academic  major  were  found  to  be 
significant  in  each  of  the  programs.  In  none  of  the  samples  were  Riot,  Nav-Tech  scores,  or  institutional 
selectivity  found  to  contribute  independently  to  the  prediction  system. 

Table  4.  Summary  of  Regression  Results 


Sourca  of  Effact 

Sltnlflcanca  Lavali  Within  SampUt 

Four  Yaar 
Scholarship* 

Thr»t  Yaar 
Scholarthlp* 

Two  Yaar 
Scholar>hlpt/Ot  har 

All  Effects  Combined 

aa 

aa 

aa 

Pilot  and  Nav/Tech  Composites 

ns 

ns 

ns 

Institutional  Selectivity  (ACT) 

ns 

ns 

ns 

Academic  Major  (S&E  vs  Other) 

aa 

aa 

a 

Officer  Quality  Composite 

a a 

aa 

aa 

•Significant  at  the  .OS  level 
“Significant  at  the  .01  level 
nsNon-significant. 


The  final  equations  identified  as  predictive  of  success  in  each  program  are  shown  in  Table  5 and 
plotted  in  Figures  1 through  3.  Looking  first  at  the  4-year  scholarship  recipients  (Figure  1),  it  wOt  be  noted 
that  the  probability  of  successful  completion  was  an  ascending  function  of  scores  on  the  Officer  Quality 
composite  for  both  S&E  and  non-S&E  students.  The  specific  function  relating  OQ  to  successful  completion 
was  nearly  linear  for  the  S&E  participants  ranging  from  an  expected  value  of  .145  for  persons  scoring  at  the 
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Tabic  5.  Final  Regression  Equations  for  Estimating  Probability  of  Success  in  AFROTC* 


Scholarship 

Program 

Academic  Major 

Science  and  Engineering 

Non-Science  and  Engineering 

Four  Year 

7 = .139964  + 

.0053467(00) 

.00005  27(00’) 

7 = .154754 

+ .0130321(00) 

.0009900(00* ) 

Three  Year 

7 = .428790  + 

.0105254(00) 

,0006354(001) 

7 = .776054 

+ .0020036(00) 

.0000882(0.0’ ) 

Two  Year/Other 

7 = .664925  ♦ 

.0075035(00) 

.0005 11 2(00’) 

7 = .666661 

+ .0075663(00) 

.0005 5 97(00’) 

Note.  — For  applications  where  academic  major  may  not  be  known,  less  accurate  but  nonetheless  serviceable  pre- 
dictions may  be  obtained  from  the  following  equations  based  on  model  5: 


Four-year  y = .161308  + .0105650(00)  .007041  0(OQ’ ) 

Three-year  y = .08821 4 + ,0043434(()Q)  .0002525(()Qa ) 

Two-year  y = .667310  + .0074751  (OQ)  .000?  390  (OQ1 ) 

AlUsed  on  model  3 described  in  Appendix  A (Table  2). 

01  percentile  level  to  a high  of  .600  at  the  95th  percentile  level.  For  students  enrolled  in  non-S&E  curricula, 
the  expected  probability  of  completion  increased  from  .168  at  the  01  level  to  a maximum  of  .584  at  the 
65th  percentile  and  decreased  slightly  thereafter.  Once  the  threshold  at  65  was  reached,  no  further 
improvements  were  noted  in  the  probability  of  success  among  these  students. 

In  the  3-year  program  (Figure  2)  diffe  ential  probabilities  of  success  were  again  noted  throughout  the 
range  of  OQ  scores  regardless  of  academic  major.  Differences  between  categories  of  academic  major  were 
evident  to  the  extent  that  the  probabilities  of  completion  for  S&E  majors  were  consistently  lower  than  for 
non-S&E  majors  throughout  the  entire  range  of  OQ  scores.  That  is,  at  fixed  levels  on  the  OQ  composite, 
students  enrolled  in  science  and  engineering  curricula  were  less  likely  to  complete  AFROTC  than  were 
students  enrolled  in  non  technical  areas.  The  probability  of  completion  for  S&E  students  increased  from 
approx' ;.iately  .44  to  .86  although  little  further  improvement  was  noted  beyond  the  75th  percentile.  For 
non-S&E  students,  the  proportion  completing  training  increased  from  .78  at  the  01  level  to  approximately 
.89  at  the  95th  percentile. 

Among  2-year  scholarship  and  other  contract  students  (Figure  3),  there  was  again  an  ascending 
relationship  between  OQ  percentile  score  and  probability  of  success  in  the  program.  Unlike  the  previous 
two  samples,  however,  the  S&E  versus  non-S&E  distinction  seemed  to  have  little  bearing  on  completion 
once  the  OQ  level  was  fixed.  For  both  groups,  probability  of  completion  increased  from  .67  to 
approximately  .93  at  the  65th  percentile  and  evidenced  very  little  improvement  thereafter.  The  numerical 
values  linking  aptitude  and  academic  major  to  the  probability  of  success  in  each  of  the  three  programs  are 
summarized  in  Table  6 

The  relative  efficiency  of  the  selection  system  identified  in  these  analyses  for  discriminating 
successful  versus  nonsuccessful  participants  during  the  FY  71  through  FY  75  time  period  is  depicted  in 
Tables  7 through  9.  These  tables  show  the  frequencies,  cumulative  frequencies,  and  cumulative  percent  of 
students  scoring  at  each  OQ  level  by  academic  major  and  training  outcome.  Also  shown  are  the  actual  and 
predicted  graduation  rates  by  OQ  level  for  S&E  and  iion-S&E  students.  For  example,  the  efTect  of  a 
simulated  requirement  that  all  S&E  participants  in  the  4-yea-  program  (Table  7)  attain  a score  of  35  or 
better  on  the  OQ  composite  would  have  been  to  eliminate  12.8%  of  the  total  S&E  group  (i.e.,  the 
cumulative  percentage  of  all  S&E  students  scoring  30  or  below).  At  the  same  time,  the  requirement  would 
have  eliminated  16.8%  of  the  eliminecs  versus  only  7.9 % of  subsequent  graduates.  Expressed  somewhat 
differently,  it  would  also  have  had  the  effect  of  eliminating  all  applicants  whose  predicted  probability  of 
completion  (expressed  as  a percent)  was  29.5%  or  below. 

For  non-S&E  students,  the  same  requirement  would  have  identified  19.2%  of  the  eliminees  as 
opposed  to  12.7%  of  the  graduates.  Similar  interpretations  can  be  made  for  the  other  percentile  levels 
shown  in  the  table.  The  effects  of  various  simulated  requirements  on  the  3-year  program  and  the  2-year 
program  are  shown  in  Tables  8 and  9,  respectively. 
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Table  6.  Probabilities  for  Successful  Completion  of  AFROTC  as  a Function 
of  Scholarship  Length,  Academic  Major  and  Percentile  Scores 


Table  7.  Frequencies,  Cumulative  Frequencies  and  Cumulative  Percent  of  Four- Year 
Scholarship  Recipients  Scoring  at  Each  AFOQT-OQ  Percentile  Level 
by  Academic  Major  and  Training  Outcome  — FY  71  Through  FY  75 
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Joint  Selection  for  AFROTC  and 
Rated  Training  Programs 

It  is  common  practice,  particularly  when  dealing  with  scholarship  students,  to  require  that  certain 
candidates  enter  rated  training  programs  (pilot  or  navigator)  upon  eventual  entry  to  active  duty.  Thus,  it 
would  be  important  to  consider  the  feasibility  of  selecting  these  students  on  the  basis  of  their  joint 
probabilities  of  completing  both  AFROTC  and  rated  training  programs.  From  previously  unpublished 
analyses  of  ROTC  graduates  in  the  Air  Force,  it  was  found  that  success  in  pilot  and  navigator  training  could 
be  estimated  from  the  Pilot  and  Navigator-Technical  composite  scores,  respectively,  in  i luch  the  same 
fashion  as  was  done  in  the  present  analysis  of  AFROTC  completion  rates.  Table  10  presents  the  empirical 
findings  of  this  research  wherein  the  probability  of  completing  rated  training  is  estimated  from  percentile 
scores  on  the  appropriate  composite.  These  estimates  are  based  on  all  AFROTC  participants  in  rated 
training  during  FY  69  through  FY  74  (N  = 7,986  pilots  and  1,924  navigators).  Additional  findings 
suggested  that  the  prediction  systems  for  both  AFROTC  and  rated  training  were  sufficiently  independent 
of  one  another  to  permit  the  computation  of  joint  probabilities  of  compfetion  as  shown  in  Appendix  B. 


Tabic  10.  Probabilities  of  Successful  Completion 
of  Rated  Training  Programs  (UPT/UNT)  as  a Function 
of  Percentile  Scores  on  the  AFOQT  Pilot 
and  Nav-Tech  Composites* 


Undargraduata  Pilot  Training 

Undorgraduata  Navigator  Training 

AFOQT-Pllot 

Compottta 

Probability  of 
Complatlng  UPT 

AFOQT-Nav/ 
Ttch  Compoilt* 

Probability  of 
Complatlng  UNT 

<20 

.663 

<20 

.769 

25 

.676 

25 

.782 

30 

.689 

30 

.793 

35 

.703 

35 

.810 

40 

.716 

40 

.823 

45 

.729 

45 

.837 

50 

.742 

50 

.850 

55 

.755 

55 

.864 

60 

.769 

60 

.877 

65 

.782 

65 

.891 

70 

.795 

70 

904 

75 

.808 

75 

.918 

80 

.821 

80 

.931 

85 

.835 

85 

.945 

90 

.m 

90 

.958 

95 

95 

.972 

aBascd  on  AFROTC  participants  in  rated  training  programs  duing  FY  69  FY 
74. 

Pilot  Equation;  7 p = .609595  + .0026514  (Pilot); 

Navigator  Equation:  = .714993  + .0027026  (Nav-Tccli) 


These  tables  show  the  joint  probability  of  completing  both  the  4-ycar  scholarship  program  and  rated 
training:  Table  Bl-for  use  with  S&E  students  expected  to  enter  undergraduate  pilot  training  (UPT),  Table 
B2-for  use  with  non-S&E  students  scheduled  to  enter  UPT;  Table  B3  -for  use  with  S&li  students  scheduled 
to  enter  undergraduate  navigator  training  (UNT);  Table  B4— for  use  with  non-S&E  students  scheduled  to 
enter  UNT. 
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For  example,  in  Table ’III,  the  probability  of  completing  both  AFROTC  and  UPT  given  OQ  = 70  and 
Pilot  = 55  is  shown  to  be  .37.  Similarly,  the  probability  of  completing  both  training  programs  given  00  = 
40  and  Pilot  = 95  is  .30.  Similar  tables  for  application  with  the  3-  and  2-year  programs  could  be  constructed 
by  simply  cross-multiplying  the  appropriate  columns  in  Tables  6 and  10. 

Some  discretion,  however,  should  be  exercised  in  the  use  of  this  information  in  an  operational  setting 
because  of  the  implied  value  judgements  associated  with  these  tables.  While  two  people  may  have  the  same 
probability  of  completion  (e.g.,  OQ  = 55;  Pilot  = 25  vs.  OQ  = 40;  Riot  = 75),  it  docs  not  necessarily  follow 
that  the  two  candidates  have  equal  \alue  to  the  Air  Force.  It  might  be  more  uesirable  (and  eventually  less 
costly  in  terms  of  attrition)  to  admit  the  candidate  with  OQ  = 40;  Riot  = 75  in  preference  to  the  one  with 
OQ  = 55;  Riot  = 25  since  relatively  larger  attrition  costs  arc  nonnally  associated  with  the  pilot  training 
programs  in  comparison  with  the  AFROTC  scholarship  program. 

As  a general  rule  for  applying  these  data,  the  operating  agency  must  consider  the  relative  value  to  the 
Air  Force  associated  with  each  of  four  joint-training  outcomes'. 

(0,)  Passed  AFROTC  -passed  pilot  training 
(02)  Passed  AFROTC-failed  pilot  training 
(0j)  Failed  AFROTC  -would  have  passed  pilot  training 
(04)  Failed  AFROTC— would  have  failed  pilot  training 

Once  specified,  the  values  may  then  be  combined  with  the  corresponding  probabilities  to  yield  the  expected 
value  (I  V)  fora  potential  candidate: 

4 

EV  = 2 V(0  )P(0 ) 

j = l 

where  V((f)  is  the  value  of  outcome  (T  and  P(0  ) is  the  possibility  of  outcome  (f.  The  ROj)  for  each  of  the 
four  possible  training  outcomes  is  computed  as  follows: 

P(0, ) = Prob  of  passing  AFROTC  x Prob  of  passing  UPT/UNT 
P(0: ) = Prob  of  passing  AFROTC  x ( I - Prob  of  passing  UPT/UNT) 

P(0j)  =(1  - Prob  of  passing  AFROTC)  x Prob  of  passing  UPT/UNT 
P(04 ) = (I  - Prob  of  passing  AFROTC)  x (I  - Prob  of  passing  UPT/UNT) 

The  probability  for  successful  completion  of  both  AFROTC  and  UPT/UNT,  designated  P(0| ),  has  been 
computed  for  the  4-year  scholarship  recipients  in  Tables  111  through  114  based  on  the  independent  estimates 
of  success  found  in  Table  6 (AFROTC)  and  Table  10  (UPT/UNT).  The  remaining  probabilities  designated 
R0; ) through  P(04 ) would  be  obtained  by  substitution  in  the  formulae  shown  above.1 

To  illustrate  the  approach,  consider  a situation  where  instead  of  maximizing  expected  value,  program 
managers  want  to  minimize  the  expected  cost  (EC)  associated  with  each  decision.  The  same  procedures 
would  be  followed  except  that,  among  a given  set  of  applicants,  the  object  would  be  to  choose  those 
representing  the  minimum  EC.  Further  suppose  that  the  average  out-of-pocket  cost  for  each  attrition  in  the 
4-ycar  scholarship  program  has  been  estimated  at  $3,000  while  corresponding  costs  for  each  attrition  in 
UPT  might  be  on  the  order  of  $17,000.  Assuming  equal  losses  of  $3,000  for  outcomes  03  and  04  and  zero 
loss  for  outcome  0| , then  the  expected  cost  ofsclcctingagivcn  candidate  would  be 

1/  4 

EC  = 2 C(OmO) 


1 Sec  dross  amt  Su  ( 1 97 S)  or  Peterson  (1975)  for  a more  complete  specification  of  procedures  for  incorporating 
utility  estimates  into  a general  selection  system. 
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where  the  C(Op  arc  separate  cost  estimates  for  each  outcome  (Cf):  0,  17,000,  3,000,  and  3,000 
respectively.  Table  1 1 summarizes  the  costs  and  probability  values  for  two  hypothetical  candidates  Both 
arc  prospective  science  and  engineering  students  designated  for  eventual  entry  into  HIT.  Candidate  A 
obtains  0Q  = 55,  Pilot  = 25  while  candidate  B obtains  OQ  = 40;  Pilot  = 75.  1 roin  Table  6,  candidate  A is 
found  to  have  a probability  of  .418  for  completing  a 4-year  scliolarslup  while  B lias  a probability  of 
completion  equal  to  .345.  From  Table  10,  the  probability  of  completing  UPT  given  Pilot  composites  of  25 
and  75,  respectively,  are  .676  for  A and  .808  for  B.  Computing  expected  costs  for  each  candidate,  it  will  be 
noted  tha  since  A has  an  FC  = 4,1 20  as  compared  to  3,140  for  B,  candidate  A would  be  less  desirable  even 
though  both  candidates  had  the  same  estimated  probability  of  completing  both  Al'ROTC  and  UI’T  (l‘|0,  j 
= .28).  The  use  of  actual  cost  factors  (or  utility  values)  would,  of  course,  yield  different  and  perhaps  more 
appropriate  strategies  for  joint  selection. 


Tabic  1 1.  Illustration  of  Expected  Cost  Computations 


com 

Candidate  A: 

Science  and  En  gin  at  ring  Major 
with  OQ  « SSi  Pilot  > 25 

Candida!*  Br 

Science  and  Engineering  Major 
with  OQ  n 40;  Pilot  « 75 

C(0,)=  0 

, v=  AERQIC* 

'0,)  (.418) 

UPTh 

= .28 

1X0,  ) = 

Al'ROTC-1 

UPT1, 

= .28 

X (.676) 

( 345) 

X (.808) 

C(02)=  17,000 

P|02)=  (.418) 

x (1  - .676) 

= .14 

F(0;)  = 

(.345) 

x (1  - 808) 

= .07 

C(0j)=  3,000 

l\0,)=  (1  418) 

x (.676) 

= .39 

1X0,)  = 

(1  345) 

x (.808) 

= .53 

C(04)=  3,000 

1\04 ) - (1  - .418) 

x ( 1 - .676) 

= .19 

1X04)  = 

(1  345) 

x (1  .808) 

= .12 

FC  = 1'  C(0)l\0,)=4120 
j=l  3 3 

FC  = Z C(0  )1’(0  ) = 3140 
j=l  3 3 

J Probabilities  of  completing;  AI-ROTC  training  jt  given  percentile  stores  on  the  l1Q  composite  .ire  obtained  front 
Tabtc  6. 

^Probabilities  of  completing  UPT  at  given  percentile  scores  on  the  pilot  composite  are  obtained  from  Table  10. 


IV.  SUMMARY  AND  CONCLUSIONS 

The  principal  conclusions  reached  as  a result  of  these  analyses  may  be  summarized  as  follows. 

I With  prior  knowledge  of  AFOQT-OQ  scores  and  academic  major  categorized  as  science  and 
engineering  versus  other  curricula,  it  is  possible  to  predict  the  probability  of  success  in  AI-KOIC 
scholarship  programs  with  a significant  degree  of  accuracy. 

2.  In  general,  there  were  found  to  be  positive  relationships  between  the  AFOQT-OQ  percentile  score 
and  training  success  in  each  of  the  prograns  included  for  analysis  4-year  scholarships,  3-year  scholarships, 
and  2-ycar  scholarships/othcr  contract  students. 

3.  Functional  relationships  between  the  OQ  composite  and  successful  completion  of  training  tended 
to  vary  by  length  of  scholarship  and  by  academic  major.  In  general,  the  effects  of  aptitude  were  more 
pronounced  in  the  4-  and  3-year  programs.  Within  scholarship  programs,  the  relative  likelihood  ot 
completing  training  at  fixed  aptitude  levels  was  found  to  he  lower  for  students  enrolled  in  science  and 
engineering  courses  than  for  those  pursuing  other  academic  majors.  The  evidence  does  not  suggest  whether 
this  differential  is  the  result  of  the  relative  difficulty  of  the  two  academic  programs  or  whether  S«Kl 
students  are  less  motivated  to  complete  training  as  compared  lo  non  S&F  students.  Further  reseaich  on  this 
issue  seems  warranted. 
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4 With  one  exception,  the  effects  of  aptitude  on  the  probability  of  completing  training  appeared  to 
he  asymptotic  lli.it  is.  the  probability  of  success  in  most  programs  increased  with  higher  aptitude  scores  up 
to  a certain  point,  after  which,  there  wxs  little  or  no  increase  in  the  expectancy  for  completion.  Merc  again, 
alternative  explanations  for  these  effects  are  plausibe.  The  aptitude  requirements  of  the  various  academic 
programs  may  be  such  that  additional  talent  beyond  a fixed  level  may  not  materially  affect  the  likelihood 
of  success  (hi  the  other  hand,  students  with  higher  aptitudes  may  be  less  motivated  to  complete  the 
Al  ROIC  program  lather  one  or  both  of  these  conditions  may  be  operative.  Among  4-year  scholarship 
students  pursuing  science  and  engineering  degrees,  the  effects  of  OQ  on  probability  of  completion  were 
more  nearly  linear  throughout  the  entire  range  of  aptitude  scores. 

5 Once  the  effects  of  the  00  composite  and  academic  major  were  accounted  for,  no  significant 
increase  in  predictive  accuracy  was  obtained  using  either  the  Pilot  or  Navigator  composite  or  the  index  of 
institutional  selectivity  These  finding  indicated  that  predictions  based  on  OQ  and  academic  major  would 
Ik  applicable  regardless  of  scores  obtained  on  the  (lying  training  composites  and  regardless  of  the  degree  of 
selectivity  exercised  by  die  host  institution. 

6.  Although  not  essential  for  predicting  training  outcomes  in  AfiROTC,  die  AFOQT  Pilot  and 
Navigator  composites  were  shown  to  be  effective  in  estimating  whether  or  not  an  applicant  will  eventually 
complete  undergraduate  pilot  and  navigator  training.  Implications  of  the  results  for  establishing  multiple 
criteria  for  joint  selection  into  AFROTC  and  subsequent  Hying  training  programs  were  discussed  within  a 
general  utility  framework. 

Rased  on  these  analyses,  it  is  recommended  that  die  AFOQT  composites  and  supplementary 
information  on  intended  academic  major  be  included  in  die  selection  system  for  scholarship  awards.  Such 
actions  would  assist  in  identifying  "high  risk”  candidates  prior  to  actual  award  of  scholarship  benefits. 
Further  efforts  to  refine  die  selection  system  based  on  analyses  of  additional  predictor  variables  appear  to 
be  warranted. 
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APPENDIX  B:  JOINT  PROBABILITY  TABLES  FOR  ESTIMATING 
COMPLETION  OF  BOTH  AFROTC  (FOUR- YEAR  SCHOLARSHIP  PROGRAM) 
AND  UPT/UNT  BASED  ON  AFOQT-COMPOSITE  SCORES 


: 


; 

i 


A 
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Tabic  III.  Probabilities  for  Successful  Completion  of  Both  the  Four-Year  Scholarship 
Program  and  UPT  as  a Function  of  Percentile  Scores  on  the  AFOOT  OQ 
and  Pilot  Composites  - Science  and  Engineering  Majors 


AFOQT— Pilot  Composite 
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.i  i 

.it 

.1 1 

.11 

.n 

.12 

12 

.12 

.12 
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I’ I : Mjrgitial  probability  of  completing  APROTC  at  given  OQ  percentile  scores. 

I’j:  Marginal  probability  of  completing  UI’T  at  given  pilot  percentile  scores. 

Tabic  1)2.  Probabilities  for  Successful  Completion  of  Both  the  Four-Year  Scholarship 
Program  and  UPT  as  a Function  of  Percentile  Scores  on  the  AFOQT  OQ  and  Pilot 
Composites -Non-Science  and  Engineering  Majors 
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20 

.25 

25 

26 

.26 

.27 

.27 

.28 

.28 

.29 

.29 

.30 

.30 

11 

31 

.32 

.32 

.376 

25 

.28 

.28 

.29 

.29 

.30 

.31 

.11 

.32 

32 

.33 

.33 

.34 

.34 

35 

.36 

.36 

.419 

30 

.30 

.31 

.32 

32 

.3.1 

.33 

.34 

.35 

.35 

.36 

.36 

.37 

.38 

.38 

.39 

39 

457 

15 

.32 

.33 

.14 

.34 

.35 

.36 

.36 

.37 

38 

.38 

.39 

.40 

.40 

.41 

.42 

42 

490 

40 

14 

.35 

.36 

,36 

.37 

.38 

38 

19 

.40 

.40 

41 

.42 

.43 

.43 

.44 

45 

.518 

45 

.36 

.3  7 

.37 

.38 

39 

39 

.40 

41 

.4  2 

.42 

.43 

.44 

.44 

.45 

.46 

.47 

,5#1 

50 

.37 

38 

.39 

.19 

40 

.41 

.41 

.4  2 

.4  3 

.44 

.44 

.45 

.46 

.47 

t47 

48 

.559 

55 

38 

19 

39 

.40 

41 

42 

.42 

.43 

.44 

.45 

.45 

.46 

.47 

,48 

AH 

49 

.572 

60 

18 

•.39 

.40 

41 

.42 

.42 

.4  3 

.44 

.45 

.45 

.46 

.47 

48 

.48 

.49 

.50 

.580 

65 

39 

.39 

40 

41 

42 

43 

.43 

44 

.45 

46 

.46 

47 

48 

49 

.50 

.50 

.584 

70 

19 

.JW 

.40 

.41 

42 

42 

.41 

.44 

45 

.45 

.46 

.47 

.48 

.48 

49 

.50 

.581 

75 

.18 

19 

40 

40 

41 

42 

.4  3 

.4  3 

44 

.45 

46 

.46 

.47 

48 

.49 

50 

.575 

80 

.17 

.38 

. >9 

.40 

40 

.41 

42 

.41 

43 

.44 

45 

.46 

.46 

.47 

.48 

.49 

564 

85 

16 

.17 

.38 

.18 

39 

.40 

.41 

.41 

.42 

43 

.4  3 

.44 

45 

46 

.46 

47 

547 

9(1 

15 

.36 

.36 

.37 

38 

.38 

.39 

.40 

.40 

.41 

.4  2 

.42 

.43 

.44 

.45 

45 

.525 

95 

13 

.34 

.34 

.15 

36 

36 

.37 

.18 

.38 

.39 

.40 

40 

.41 

.4’ 

42 

43 

499 

I’j 

.663 

.676 

.689 

.703 

.716 

.729 

.742 

.755 

.769 

.782 

.795 

.808 

.821 

.835 

.848 

861 

I'l  Marginal  probability  of  conplcting  Al  KOTC  at  given  (XJ  percentile  scores. 
I’j  Marginal  probability  of  completing  lll’T  at  given  pilot  percentile  scores. 
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Table  B3.  Probabilities  for  Successful  Completion  of  Both  the  Four-Year  Scholarship 
Program  and  UNT  as  a Function  of  Percentile  Scores  on  the  AFOOT  -00  and  Nav-Tech 
Composites  (Science  and  Engineering  Majors) 


AFOUT  Nav-Tech  Composite 


AFOQT-OQ 

Composltt 

<20 

25 

30 

35 

40 

45 

50 

55 

SO 

65 

70 

75 

ao 

IS 

90 

95 

01 

.1  1 

.ii 

.12 

.12 

.12 

.12 

.12 

.12 

.13 

.13 

.13 

.13 

13 

14 

.14 

14 

145 

05 

.13 

.13 

.13 

.14 

.14 

.14 

.14 

.14 

.15 

.15 

.15 

.15 

.16 

.16 

.16 

.16 

.167 

10 

.15 

.15 

.15 

.15 

.16 

.16 

.16 

.16 

.17 

.17 

.17 

.17 

.18 

.18 

.18 

.18 

190 

15 

.17 

.17 

.17 

.18 

18 

.18 

.19 

.19 

.19 

.20 

.20 

.20 

20 

.21 

.21 

.21 

.219 

20 

.18 

.19 

.19 

.19 

.20 

.20 

.20 

.21 

.21 

.21 

.22 

.22 

22 

.23 

.23 

.23 

.240 

25 

.21 

.21 

.21 

.22 

.22 

.23 

.23 

.23 

.24 

.24 

.24 

^25 

.25 

.26 

.26 

.26 

.270 

30 

.23 

.23 

.23 

! 2 4 

.24 

.25 

.25 

.25 

.26 

.26 

.27 

.27 

.27 

.28 

.28 

.29 

.295 

35 

.25 

.25 

.25 

.26 

.26 

.27 

.27 

.28 

.28 

.29 

.29 

.29 

.30 

.30 

.31 

.31 

320 

40 

.27 

.27 

.27 

.28 

.28 

.29 

.29 

.30 

.30 

.31 

31 

32 

.32 

.33 

.33 

34 

.345 

45 

.28 

.29 

.29 

30 

.30 

.31 

.31 

.32 

.32 

33 

33 

.34 

.14 

.35 

.35 

.36 

.770 

50 

.30 

.31 

.31 

.32 

.32 

.33 

.33 

.34 

.35 

.35 

36 

36 

.77 

.37 

.38 

38 

.394 

55 

.32 

.33 

.33 

.34 

.34 

.35 

.36 

.37 

.36 

.37 

.38 

38 

.79 

.39 

.40 

41 

.418 

60 

.34 

.35 

.35 

.36 

36 

.37 

.37 

.38 

.39 

.39 

40 

40 

.4  1 

42 

.42 

.4  3 

441 

65 

.36 

.36 

.37 

.38 

.38 

39 

.40 

.40 

.41 

41 

.42 

43 

4 3 

.44 

.45 

.4  5 

465 

70 

.38 

.38 

.39 

.40 

.40 

.41 

.41 

.42 

.4  3 

.4  3 

.44 

45 

.45 

.46 

.47 

.47 

.488 

75 

.39 

.40 

.41 

.41 

.42 

.43 

.4  3 

.44 

45 

.46 

.4  6 

.4  7 

.48 

.48 

49 

.50 

511 

80 

.41 

.42 

.42 

.4  3 

.44 

.45 

.45 

.46 

.47 

.47 

.48 

49 

.50 

.50 

.51 

.52 

.533 

85 

.43 

.44 

.44 

.45 

.46 

47 

.47 

.48 

.49 

.50 

.50 

.51 

.52 

.53 

.53 

S4 

.556 

90 

.44 

.45 

.46 

.47 

.48 

.48 

.49 

.50 

.51 

.51 

.52 

.53 

.54 

.55 

.55 

.56 

578 

95 

.51 

.51 

.52 

.52 

.53 

.53 

.54 

54 

.55 

.55 

.56 

.56 

.57 

.57 

.58 

58 

.600 

Pj 

.769 

.782 

.793 

.810 

.823 

.837 

.850 

.864 

.877 

.891 

.904 

.918 

.931 

945 

.958 

972 

P,  Marginal  probability  of  completing  At  KOTC  at  given  OQ  percentile  scores. 

P,  Marginal  Probability  of  completing  UNT  at  given  Nav-Tech  percentile. 

Tabic  B4.  Probabilities  for  Successful  Completion  of  Both  the  Four-Year  Scholarship 
Program  and  UNT  as  a Function  of  Percentile  Scores  on  the  AFOOT-  OQ  and  Nav-Tech 
Composites  (Non-Science  and  Engineering  Majors) 


AFOQT  Nav*T«ch  Composite 


AFOQT-OQ 
Composite  <20 

25 

30 

35 

40 

45 

50 

55 

60 

65 

70 

75 

•0 

85 

90 

95 

Pi 

01 

.13 

.13 

.13 

.14 

.14 

.14 

.14 

.15 

.15 

.15 

.15 

.15 

16 

.16 

.16 

.18 

.168 

05 

.17 

.17 

.17 

.18 

.18 

.18 

.19 

.19 

.19 

.19 

.20 

.20 

.20 

.21 

.21 

.21 

.218 

10 

.21 

.22 

.22 

,22 

.23 

.23 

.23 

.24 

.24 

.24 

.25 

.25 

.26 

.26 

.26 

.27 

.275 

15 

.25 

.26 

.26 

.27 

.27 

.27 

.28 

.28 

.29 

.29 

.30 

30 

.31 

3| 

,3| 

.32 

328 

20 

.29 

.29 

.30 

.30 

.31 

.31 

.32 

.32 

.33 

.33 

.34 

.35 

.35 

.36 

.36 

.37 

.3  76 

25 

.32 

.33 

.33 

34 

.34 

.35 

.36 

.36 

.37 

.37 

.38 

.38 

.39 

40 

.40 

41 

419 

30 

.35 

.36 

.76 

.37 

.38 

38 

.39 

.39 

.40 

41 

.41 

.42 

.4  3 

.43 

.44 

44 

,457 

35 

.38 

.38 

39 

.40 

.40 

41 

42 

.4  2 

.43 

.44 

44 

.45 

.46 

46 

47 

48 

490 

40 

.40 

.41 

.41 

.4  2 

.4  3 

43 

.44 

45 

45 

46 

.47 

.48 

.48 

49 

50 

50 

.518 

45 

.42 

.42 

4 3 

44 

.45 

.45 

.46 

4 7 

.47 

.48 

.49 

.50 

.50 

51 

.52 

.53 

541 

50 

.43 

.44 

.44 

.45 

.46 

.47 

.48 

.48 

.49 

.50 

.51 

51 

.52 

.53 

.54 

54 

.559 

55 

.44 

45 

.46 

.46 

.47 

.48 

49 

.49 

.50 

.51 

.52 

.S3 

.53 

54 

.55 

56 

572 

60 

.45 

45 

46 

47 

.48 

.49 

.49 

.50 

.51 

.52 

.52 

.53 

.54 

.55 

.56 

56 

.580 

65 

.45 

46 

.46 

.47 

.48 

49 

.50 

50 

.51 

.52 

.5  3 

S4 

.54 

.55 

56 

.57 

.584 

70 

.45 

.45 

.46 

.4  7 

.48 

.49 

.49 

.50 

51 

52 

.53 

S3 

.54 

.55 

56 

,56 

581 

75 

.44 

.45 

46 

.47 

.47 

.48 

.49 

.50 

.50 

.51 

.52 

53 

54 

54 

.55 

.50 

575 

80 

.43 

44 

.45 

46 

.46 

47 

4 8 

.49 

49 

.50 

.51 

52 

53 

.53 

54 

.5.5 

564 

85 

.42 

.4  3 

.44 

44 

.45 

.46 

.47 

4 7 

.48 

.49 

.49 

.50 

.51 

52 

.52 

.53 

547 

90 

.40 

.41 

42 

.4  3 

4 3 

.44 

.45 

45 

.46 

.4  7 

.47 

.48 

49 

50 

.50 

. 5 1 

.525 

95 

38 

.39 

40 

.40 

41 

42 

.4  2 

.4  3 

44 

44 

.4  5 

40 

46 

.47 

48 

49 

.499 

P2 

.769 

.782 

.793 

.810 

.823 

.837 

.850 

.864 

.877 

.891 

.904 

.918 

.9  31 

.945 

.958 

972 

P, . Marginal  probability  of  completing  AFROTL’  at  given  (X}  percentile  stores. 
Pj  : Marginal  probability  of  completing  UNT  at  given  Nav -Tech  percentile  semes. 
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